Avoid Unsloth import in Megatron service by Kovbo · Pull Request #686 · OpenPipe/ART

Kovbo · 2026-05-20T21:37:10Z

Summary

stop importing ART's Unsloth training stack from art.megatron.service at module import time
add a local GC/CUDA cleanup helper for MegatronService
keep create_identity_lora usable in Megatron-only environments without requiring TRL/vLLM side imports

uv run --with ruff ruff check src/art/megatron/service.py
PYTHONPATH=/tmp/art-serverless-fix/src uv run python - <<'PY' from art.megatron.service import create_identity_lora print(create_identity_lora.__name__) PY
created identity LoRA for Qwen/Qwen3-30B-A3B-Instruct-2507 with rank 1

Kovbo requested a review from bradhilton May 20, 2026 21:37

Kovbo marked this pull request as draft May 20, 2026 21:37

Kovbo requested review from FurtherAI and removed request for FurtherAI and bradhilton May 20, 2026 21:37

Kovbo force-pushed the kovbo/megatron-service-avoid-unsloth-import branch from 26edd52 to a2019a6 Compare May 21, 2026 00:10

Kovbo changed the title ~~Avoid Unsloth import in Megatron service~~ Fix Megatron service imports and Qwen3 identity LoRA export May 21, 2026

Avoid Unsloth import in Megatron service

8014898

Kovbo force-pushed the kovbo/megatron-service-avoid-unsloth-import branch from a2019a6 to 8014898 Compare May 21, 2026 18:47

Kovbo changed the title ~~Fix Megatron service imports and Qwen3 identity LoRA export~~ Avoid Unsloth import in Megatron service May 21, 2026